Peer review
Rebuttal
Doing a review
Studies on peer review
Does peer review work?
Reviewer matching and algorithms
- Charlin2013Toronto: Toronto Paper Matching System
- An Overview of Challenges, Experiments, and Computational Solutions in Peer Review
- Saveski2023counterfactual
AI in peer review
Peer review protocols
- Gross2021why - ex post vs ex ante
Peer review biases
Simcoe2010status and Tomkins2017reviewer demonstrated Bias in peer review.
“Reviewer #2 is not the problem. Reviewer #3 is.”
Experiments
- 2014 NeurIPS experiment: http://inverseprobability.com/2014/12/16/the-nips-experiment/
- http://blog.mrtz.org/2014/12/15/the-nips-experiment.html
- Cortes2021inconsistency - NeurIPS 2014 experiment
- Single versus Double Blind Reviewing at WSDM 2017
- The NeurIPS 2021 Consistency Experiment
History
Articles
- http://sunelehmann.com/2010/08/24/no-more-supporting-material/ - How can we solve “supplemental material arms race”?
- Peer review and the meat grinder by Aaron Clauset
- http://www.genomesunzipped.org/2011/07/why-publish-science-in-peer-reviewed-journals.php
- http://www.guardian.co.uk/science/2011/sep/05/publish-perish-peer-review-science
- http://www.timeshighereducation.co.uk/story.asp?sectioncode26&storycode=417576&c1 - don’t review for free, for closed journals.
- The Nastiness Problem in Computer Science by Bertrand Meyer
- Yes, Computer Scientists Are Hypercritical by Jeannette M
- A world without referees by Larry Wasserman
- Who’s Afraid of Peer Review?
- Reviewing the reviewers
- A little bias in peer review scores can translate into big money, simulation finds
- Let’s make peer review scientific